Formal Semantics for Iconic Gesture
نویسندگان
چکیده
We present a formal analysis of iconic coverbal gesture. Our model describes the incomplete meaning of gesture that’s derivable from its form, and the pragmatic reasoning that yields a more specific interpretation. Our formalism builds on established models of discourse interpretation to capture key insights from the descriptive literature on gesture: synchronous speech and gesture express a single thought, but while the form of iconic gesture is an important clue to its interpretation, the content of gesture can be resolved only by linking it to its context.
منابع مشابه
A Formal Semantic Analysis of Gesture
This paper presents a formal semantics for productive iconic and deictic gestures that speakers use in tandem with speech in face-to-face conversation. In contrast to conventionalised, emblematic gestures, the meaning that productive gestures derive from their form is incomplete, and their content can be determined only through links to context, including previous gestures and simultaneous spee...
متن کاملInterpretation of Shape-Related Iconic Gestures in Virtual Environments
So far, approaches towards gesture recognition focused mainly on deictic and emblematic gestures. Iconics, viewed as iconic signs in the sense of Peirce, are different from deictics and emblems, for their relation to the referent is based on similarity. In the work reported here, the breakdown of the complex notion of similarity provides the key idea towards a computational model of gesture sem...
متن کاملImitation Games with an Artificial Agent: From Mimicking to Understanding Shape-Related Iconic Gestures
We describe an anthropomorphic agent that is engaged in an imitation game with the human user. In imitating natural gestures demonstrated by the user, the agent brings together gesture recognition and synthesis on two levels of representation. On the mimicking level, the essential form features of the meaning-bearing gesture phase (stroke) are extracted and reproduced by the agent. Meaning-base...
متن کاملA Hybrid Grammar-Based Approach for Learning and Recognizing Natural Hand Gestures
In this paper, we present a hybrid grammar formalism designed to learn structured models of natural iconic gesture performances that allow for compressed representation and robust recognition. We analyze a dataset of iconic gestures and show how the proposed Featurebased Stochastic Context-Free Grammar (FSCFG) can generalize over both structural and feature-based variations among different gest...
متن کاملLearning from gesture: How early does it happen?
Iconic gesture is a rich source of information for conveying ideas to learners. However, in order to learn from iconic gesture, a learner must be able to interpret its iconic form-a nontrivial task for young children. Our study explores how young children interpret iconic gesture and whether they can use it to infer a previously unknown action. In Study 1, 2- and 3-year-old children were shown ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2006